System and method of presenting synchronous picture-in-picture for consumer video players

ABSTRACT

A media playback device capable of displaying multiple streams simultaneously and with expanded picture-in-picture capabilities is provided. The placement, size, aspect ratio, cropping, scale, transparency, tint, contrast, and cropping of the media can be set or adjusted arbitrarily. Furthermore, the audio may be mixed between separate tracks accompanying the video streams and may also be set or adjusted arbitrarily. Each variable can be dynamically changed during playback through either automated or user-initiated means. A system and method are provided for simultaneously displaying a first video stream and at least a second video stream on a display comprising the steps of feeding the video streams into a video player; providing control of the display of the video streams; displaying a first video stream substantially across the display; and displaying the other video streams in a secondary display.

RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationNo. 60/475,340, filed Jun. 2, 2003, which is incorporated herein byreference in its entirety. This application is also related to U.S.Utility Patent Application No. ______ entitled “System And Method OfInteractive Video Playback” (Docket No. 54317-026701); U.S. UtilityPatent Application No. ______ entitled “System And Method Of DynamicInterface Placement Based On Aspect Ratio” (Docket No. 54317-026801);U.S. Utility Patent Application No. ______ entitled “System And MethodOf Video Player Commerce” (Docket No. 54317-026901); and U.S. UtilityPatent Application No. ______ entitled “Video Playback Image Processing”(Docket No. 54317-027101); all of which are filed concurrently herewithon Jun. 2, 2004, and incorporated by reference herein in their entirety.

BACKGROUND

1. Field

In general, the field of the invention relates to digital video control.Specifically, the field of the invention relates to picture in picturefunctionality in digital formats.

2. General Background and State of the Art

Interactive multimedia provides for a user to more fully appreciate asubject by exploring the varied multimedia resources available.Interactive multimedia includes the integration of text, audio,graphics, still image and moving pictures into a single,computer-controlled, multimedia product. The desire for interactivemultimedia grows along with the desire for increasing data storage forthese programs.

In one conventional application, interactive media is used as a learningtool for a user. The multimedia platform provides many advantages,including the ability to customize to the user's abilities andpreferences. As a result, the user can control the path of the lesson.The multimedia lesson may direct the user through information or,alternatively, allow the user to explore the many facets on his own. Bycustomizing the interface and levels of guidance for each user, theinteractive multimedia program provides more effective learning.Interactive multimedia is not just limited to educational means; it mayalso be utilized for entertainment, presentations, and the like.

DVDs and other digital media players, such as high definition videoplayers and software DVD-ROM, provide an increased amount of datastorage and, thus, more avenues for media integration. Increased storagecapacity translates into the ability to hold more information on asingle disc or drive. In addition to increased storage capacity, thisdigital media can provide higher quality video and audio. Programmingoptions include labeling segments of a film, wherein the user can selectthe segment for direct viewing. Often, these segments appear in anon-screen index available to the user from the top DVD menu or main menuscreen. As a result, the user cannot select a desired scene withoutstopping the playing of the film and returning to the main menu screen.

DVDs are limited in that they cannot display at least two simultaneousstreams of data throughout a transmission. Conventional systems allowfor a user to select different angles during playing of the DVD. When analternative angle is selected, display changes from a first angle to theselected angle. In order to view alternative angles, a menu or index isnot available during the playing of the DVD. Once again, the user mustreturn to the main menu to preview the various angles. During play, theuser can toggle through the various angles by continuously pressing the“angle” button on a remote control. The user must continue to togglethrough the angles until satisfied with a view currently displayed onthe screen. As a result of not being subject to the different angles atall times, the user is unaware of other angles that may provide a betterview through a different angle.

Attempts to display numerous streams of video and/or audio have hadlimited success. Many types of media have been employed to attempt toprovide more viewing options for the user. CD-ROMs are one suchconventional attempt. CD-ROMs are similar to DVDs, but have a muchsmaller capacity. With such a small capacity, streaming video utilizes asignificant amount of storage. As a result, the ability to display a fewstreams of video simultaneously is limited by the amount of storage.

Conventional televisions provide the ability to view two channelssimultaneously. This television feature is known as picture-in-picture.Picture-in-picture displays a primary television broadcast as usual onthe television screen. A second television broadcast is overlaid on theprimary television broadcast in a rectangular-shaped box substantiallynear the corner of the television display. The rectangular-shaped box ispositioned such that it may be blocking a desirable portion of the firstbroadcast. The user does not have the option to reposition the box toanother location on the screen. Additionally, the user cannot resize thebox to become larger or smaller. Similarly, the aspect ratio of the boxis predetermined and fixed. Essentially, the box is “static.”

The operating systems of personal computers utilize “windows” to displaycontent. While the operating system windows provide some solutions tothe static television picture-in-picture, conventional operating systemsdo not allow for simultaneous viewing of streaming data in sufficientlycustomizable “windows.” Each window is often the result of running a newprogram. The operating system is limited in its ability to providemultiple audio or video data streaming simultaneously in a plurality ofcustomizable windows on the screen. Further, the use of windows on anoperating system for a personal computer does not translate to atelevision viewing apparatus. A television cannot be readily adapted toprovide windows similar to an operating system.

In viewing digital format, a user desires the ability to viewsimultaneous streaming audio and/or video, along with the ability tocustomize and manipulate the various media. More specifically, the userdesires an ability to reposition streaming media on a screen, change thesize of the streaming media on the screen, mix the audio of thestreaming media with a primary transmission, use a “zoom” feature withinthe streaming media, crop the streaming media, alter the aspect ratio ofthe streaming media, choose a layering format for the various media, andmodify the visual properties of the media such as transparency, tint,and contrast.

These conventional systems neither achieve nor teach the simultaneousviewing of interleaved audio and/or video streams with these desiredfeatures. Providing such a capability in a next generation of videoplayback devices will give consumers great freedom to customize theirown viewing experiences. Additionally, improvements to the playbackplatform can also increase the ability of artists and content companiesto provide innovative viewing experiences.

SUMMARY

A system and method of programmatic window control provides videoplayback devices with the ability to display multiple media streamssimultaneously on the same screen. Video playback devices include, butare not limited to, DVD players, High-Definition video players, PCDVD-ROMs, and the like. The properties of the media streams can bydynamically and independently controlled either by user input or byprogrammatic means.

The present disclosure expands on the concept of picture-in-picture forvideo playback devices by providing such a format along withcustomizable features. The placement, size, aspect ratio, cropping,scale, transparency, tint, contrast, and cropping of the media can beset or adjusted arbitrarily. Furthermore, the audio may be mixed betweenseparate tracks accompanying the video streams and may also be set oradjusted arbitrarily. Each variable can be dynamically changed duringplayback through either automated or user-initiated means.

In one embodiment, a first video stream and a second video stream aresimultaneously displayed on a display. The first and second mediastreams are received by a media playback device comprising a processor.The first and second video streams are synchronized such that at least aportion of each of the video streams are displayed synchronously. Thefirst video stream is displayed on the display, wherein the first videostream substantially extends across the display. The second video streamis optionally displayed in a customizable secondary display, wherein thesecond video stream has a playback synchronized to the playback of thefirst video stream. A third video stream may be provided to the mediaplayback device and displayed in the customizable secondary display.

The at least one of the plurality of video streams may come fromremovable media such as a DVD or CD, or an Internet source, a personalcomputer, a hard drive, a LAN storage, or a server. The media playbackdevice may be a DVD player, a personal computer, a home media server, ahigh definition video player, an optical player, a hard drive basedplayer, or a software DVD-ROM player.

In one embodiment, the customizable secondary display is displayed bychoosing a menu option, perhaps through the use of an input device suchas a remote control. Descriptive text, such as the name of the menu itemmay be displayed on the customizable secondary display.

In one embodiment, the customizable secondary display can be resized orthe aspect ratio can be altered. The aspect ratio of the at least asecond video stream can also be altered. The first video stream can beswapped with one of the at least a second video stream, wherein thefirst video stream is displayed in the customizable secondary displayand one of the at least a second video stream is displayed substantiallyacross the display. The customizable secondary display can berepositioned to another location on the display. The at least a secondvideo stream in the customizable secondary display can be replaced withthe third video stream. The third video stream can be displayed inaddition to at least a second video stream in the customizable secondarydisplay.

The user can vary the audio properties of the first video stream and atleast a second video stream. The secondary display can be resized toextend substantially across the display wherein the at least a secondvideo stream overlays the first video stream. The user can change thecustomizable secondary display properties through a remote control,mouse, or keyboard, or gaming controller.

Another embodiment provides a system for displaying a first and a secondvideo stream on a display, the system comprising a media playback devicefor receiving and playing the first and second video streams, whereinthe first and second video streams are provided from a media source tothe media playback device, and wherein the media playback device playsthe first video stream on the display; the media playback device havinga CPU and a media co-processor, wherein the CPU receives commands of auser and commands the media co-processor to display or modify the firstand second video stream and the secondary display. The system furthercomprises a remote control, mouse, keyboard, or gaming controller tocommand the CPU. The system further comprises a cursor on the display toassist the user with modifying the properties of the secondary display.The system further comprises an executable file, wherein the CPU runsthe executable file to modify the properties of the video streams andthe secondary display. The executable file further comprises controldata, the control data having customizable properties for the secondarydisplay. The executable is embedded in at least one video stream. Theexecutable file may be provided in a stream other than the first orsecond video streams.

Still another embodiment provides a method for a media playback deviceto display at least two video streams on a display, the methodcomprising the steps of receiving at least two video streams in a mediainterface of the media playback device; receiving an running anexecutable file in a CPU of the media playback device; checking by theCPU of the at least two video streams for metatags; receiving a commandat the CPU from a user to modify at least one of the at least two videostreams on the display; commanding a media co-processor to provide themodified at least one of the at least two video streams to an outputbuffer for display; maintaining alignment of at least two video streamsbased on the meta-tags; and optionally displaying an aligned at least asecond of the at least two video streams on the display. A relativeoffset between the at least two video streams is maintained.

The foregoing and other objects, features, and advantages will becomeapparent form a reading of the following detailed description ofexemplary embodiments thereof, which illustrate the features andadvantages of the invention in conjunction with references to theaccompanying figures.

DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding and are incorporated in and constitute a part of thisspecification, illustrate embodiments of the invention and together withthe description serve to explain the principles.

FIGS. 1 a-1 b are flow diagrams of the system according to anembodiment.

FIG. 2 is a display with a secondary display according to an embodiment.

FIGS. 3 a-3 d are displays with modified secondary displays according toan embodiment.

FIGS. 4 a-4 c are displays with modified secondary displays according toan embodiment.

FIGS. 5 a-5 b are displays with modified secondary displays according toan embodiment.

FIG. 6 is a display with a secondary display according to an embodiment.

FIGS. 7 a-7 b are displays with modified secondary displays according toan embodiment.

FIG. 8 is a display with a secondary display according to an embodiment.

FIGS. 9 a-9 b are displays with modified secondary displays according toan embodiment.

FIG. 10 is a display with a secondary display overlay according to anembodiment.

FIG. 11 is a display with a secondary display and audio mixing accordingto an embodiment.

DETAILED DESCRIPTION

The system and method add picture-in-picture functionality to mediaplayers. Specifically, the system and method apply to video players,including but not limited to DVD players, high definition video players,software DVD-ROM players, high definition video players, hard drivebased players, optical players, personal computers, or any other mediaplayer known to one of ordinary skill in the art.

Referring to FIG. 1 a, a media playback device 100 receives at least twostreams of media data. Optionally, the at least two streams of mediadata are streamed to the video player 100 such that the media data of afirst data stream corresponds in timing to at least a second datastream. The data streams may be logically multiplexed data feeds or frommultiple sources, or a combination of the two.

Data streams may be logically multiplexed data feeds, as illustrated bymultiplex data feed 45. Multiplex data feed 45 is a combination of datafeeds 10, 20, 30, 40 encoded in the same data feed 45. Data feeds 10,20, 30, 40 may be transmitted from a CD, CD-ROM, DVD, DVD-ROM,television cable provider, or other data storage or transmittal deviceknown in the art for providing multiple data streams. In an exemplaryembodiment, a high definition video player contains a movie along withan additional four multiplexed video and audio tracks. These additionalfour multiplexed video and audio tracks contain scenes and additionalmaterial. The four multiplexed video and audio tracks are timed to matchrelated content in the movie playing from the main video stream.Multiplexed data feed 45 may communicate with video player 100 throughwireless means or a wired network.

Simultaneously, an audio and/or video feed from the Internet 50 may betransmitting to video player 100 from an Internet source. The Internetsource includes a personal computer, personal media player, or otherdevice known in the art for transmitting data from the Internet. TheInternet source may communicate with video player 100 through wirelessmeans or a wired network.

Additionally, a home media server may transmit video streams 60, 70 tovideo player 100. The home media server may contain a mixture of audioand video formats of movies, songs, or other multimedia to betransmitted in streams 60, 70. The home media server may communicatewith video player 100 through wireless means or a wired network.

A media playback device has a host CPU or processor 115, a mediainterface 105, a media co-processor 110, and an output buffer 125. Mediainterface 105 receives the various streams of media. The media may bemultiplexed or separate streams. The media stream may also include anexecutable file. The executable file contains logic for placement ofvideo streams on the display, resizing, demultiplexing video streams,and other functions known to one of ordinary skill in the art. Theexecutable file is provided to CPU 115 via a control stream.

The executable file utilizes control data, which may be embedded on thevideo player, on the media, or from an alternative source. such as theInternet or a home media server. The executable file is optionallyresident on the media. The executable file may also be loaded from anexternal storage media, embedded in firmware, burned into the logic on adedicated computer chip, or received from a separate media stream. Forexample, the executable file may be provided via the internet 80 or aserver 75, LAN storage 85, hard or floppy disk, CD or DVD, memory card,or other conventional means of storing and providing data. When theexecutable file is not resident on the media, the executable file goesdirectly to CPU 115, rather than through media interface 105.

CPU 115 executes the code in the executable file. CPU 115 analyzestiming, synchronization, and display properties of the streams, as wellas application logic and user input. Display properties include scale,alpha transparency, position, rotation, etc. CPU 115 checks for timecode, embedded metadata, and markers. The CPU also accesses videomemory, enabling the system to arbitrarily insert graphics and text. Inone embodiment, the CPU commands the system to send force feedbackinformation to a gaming controller. The gaming controller might shake orvibrate corresponding to action on the screen.

The user may instruct CPU 115 through a remote control 90. Remotecontrol 90 sends messages via infrared, internet protocols, or othercontrol stream. Remote control 90 may be a conventional remote control,mouse, keyboard, or a gaming controller. CPU 115 receive commands fromthe user and makes logical decisions concerning the video streams.

The video streams are provided from media interface 105 to mediaco-processor 110. Media co-processor 110 receives commands from CPU 115through media application program interfaces. Media co-processor 110composites the video streams according to the instructions by CPU 115and sends them to output buffer 125 for video output on display 120.Media co-processor 110 comprises hardware and software, although mayfunction only as software. In another embodiment, media playback device100 comprises several decompressors for the various video streams.

In one example, DVD media provides four video streams and an executablefile to the media interface. The media interface sends the CPU theexecutable file and sends the video streams to the media co-processor.When the user uses the remote control to choose a secondary video streamto be displayed, the CPU sends a command to the media co-processor todisplay both video streams one and two in the format provided. The CPUalso ensures synchronization of the streams. The composited image issent to the output buffer, which has sufficient memory to provide asynchronized video output without any breaks due to user commands.

The media playback device ensures synchronized playback of videostreams. Referring to FIG. 1 b, a media playback device 101 receives aplurality of video streams 124, 134, 144. Each video stream comprisesthree components: a video asset, an audio asset, and a time asset. Videostream 124 comprises video asset 125, audio asset 126, and time asset127; video stream 134 comprises video asset 135, audio asset 136, andtime asset 137; video stream 144 comprises video asset 145, audio asset146, and time asset 147. CPU 116 of media playback device 101 processesthe metadata of video streams 124, 134, 144. The metadata may be withineach video stream or provided in a separate stream to media playbackdevice 101. As video streams 124, 134, 144 maintain relative offsetbased on their metadata, the CPU aligns the metadata such that a mediaco-processor 111 can provide video streams 124, 134, 144 in asynchronized fashion. Video streams 124, 134, 144 may contain content ofvarying lengths. CPU 116 aligns video and audio assets 125, 126, 135,136, 145, 146 of varying length and media co-processor 111 sendsarranged video and audio content to the display for viewing.

In one exemplary embodiment, video and audio streams 125, 126 arereceived at a time within its playback of 1:12:68. Video and audiostreams 135, 136 are received at a time within its playback of 1:15:22.Video and audio streams 145, 146 are received at a time within itsplayback of 1:20:05. The logic in the executable maintainssynchronization of the streams along playback. As one stream advancesduring playback, all other streams advance at a rate to maintainsynchronization. Such a feature becomes desirable when streams arereceived from separate sources and are difficult to properly synchronizefrom the start. Media co-processor 111 receives the streams andmaintains the relative offset for the various streams without any framedrift.

The media playback device presents a menu to the user during theoperation of media. This menu may be presented before or during playbackof the media. Upon a depression of a button on a remote control,joystick, or keyboard, a click on a mouse, or other activation through aremote device, an on-screen menu 50 is displayed.

The media co-processor provides the video streams for display. The CPUcommands the control program to display certain streams as well as agraphic display to accompany the video streams. The display of themultiple data streams may be in a secondary display on the screen. Thesecondary display may be a rectangular-shaped arrangement of themultiple video streams.

The media playback device coordinates a layout of the secondary display.The media playback device may assert control either through directcontrol of the media playback device's video display buffer or,alternatively, through coordination of dedicated graphics hardware. Inresponse to a user's command or according to programming, the CPUcommands the media co-processor to show, hide, resize, reshape, move, orreposition any of the streaming data under its coordination. Due to theprocessing of the video streams, display properties can be changed onthe display through arbitrary means and at the video frame-rate, thusnot displaying any visible video display artifacts or frame drift.

The CPU can modify the video streams based on input. In an exemplaryembodiment, the video streams may be rearranged within the display.Referring to FIG. 1 a, in another exemplary embodiment, data feeds 10,20, 30, 40 are provided from a DVD. However, upon an input, the mediaplayback device displays home media video stream 60. Home media videostream 60 may be display in addition or in the place of any or all ofdata feeds 10, 20, 30, 40. This input can come in the form ofuser-initiated input or through a stream or token of control data.User-initiated input may be provided through the use of a mouse, remotecontrol, or other similar device known to one of ordinary skill in theart wherein user commands are transmitted from the input device tocontrol program of the media playback device.

The embedded code or control data for providing arrangement andmodification of the secondary display may be located within theexecutable file in the media playback device, within the video stream,or from an external source such as the Internet or a server. In oneembodiment, control data in the executable file is placed within thevideo data. As the video plays, control data of the executable filestreams into the media interface. This particular embodiment has theability to store control data within the video streams, instead ofstoring the control data on the video player or transmitting from anexternal source. As a result, each video may have highly customizedcontrol data for that application, such as a particular brand name orlogo, or a design theme that coordinates with the subject matter of thevideo. The control data may also be loaded separately from theexecutable file, preloaded, or streamed into the control program fromremote sources or non-volatile storage media.

In an alternative embodiment, the display properties of the videostreams are determined by control data in a separate stream. Duringplayback, the control data streams through CPU to drive the arrangementand display properties. In one embodiment, before playback of a movie, amedia playback device with access to the Internet is connected to aserver that streams synchronized control data. The control data may besupplied in the streaming media by the creators of the streaming media.As the video plays, the control data provides customized applicationsfor the executable file to allow the CPU to rearrange, zoom, and resizethe video material to create an animating, optimized, high-qualitypresentation of the combined video streams.

The media playback device allows for an on-screen menu to appear. Theuser can view the menu through activation by a mouse-click or bydepressing a button on the remote control. The on-screen menu provides aplurality of options. One such option may be to view alternative anglesof a movie or a documentary of the making of the movie. By selectingthis option, the user is enabling “Multi-View Mode.” Alternatively, theselection of Multi-View Mode might be enabled by pressing a particularbutton on a remote control. For example, a button labeled as“Multi-View” may activate any available multiple video streams availableto the user. Multi-View Mode may be activated at any point duringplayback of the video. In order to select other options or features, theuser may activate the menu during playback of the video, rather thanreturning to the main menu. As the main video plays and upon activationof Multi-View Mode, the CPU commands the media co-processor to show asecond video stream with accompanying graphics. On the display, asecondary display in the lower left corner appears. Within the secondarydisplay is at least one other video stream besides the main video.

Referring to FIG. 2, a movie 210 is playing on a display 200. A userselects “Documentary” from an on-screen menu. In the lower left corneris a secondary display 220. Secondary display 220 may be placed in thelower left corner as a default position. Secondary display 220, althoughappearing in the lower left corner, may appear anywhere on the screen.Secondary display 220 contains streaming video tracks 221, 222, 223,224. Streaming video tracks 221, 222, 223, 224 may include “behind thescenes” footage, video that provides a basis for the scene, analternative angle of the scene, commentary, or any other video thatcould be used to enhance the experience of the user.

Video tracks 221, 222, 223, 224 appear to play over the main video, ingraphically defined “windows.” Substantially surrounding and betweeneach streaming video track 221, 222, 223, 224 is a graphic design of awindow or border 230. Secondary display 220 also contains the chosenmenu option, in this case, Documentary 240. Optionally, a marking ortext 250 may appear in the corner of display 200 during all of playbackto indicate that a menu or options are available to a user.

The graphical images do not exist in the video stream, but are drawndynamically around the scaled video streams by the media co-processor.The media co-processor draws images unrelated to video into the displaybuffer of the media playback device. Such images include, but are notlimited to, a design substantially around the streaming video, text ofinstructions, or text of a brand name. The images drawn into the displaybuffer may serve as a guide to using the multiple feeds or as anaesthetical enhancement for the multimedia experience. Border 230,Documentary 240, and marking 250 are examples of such images drawn intothe display buffer.

The drawings for secondary display 220 are based on generic layouts andtemplates. The generic layout may comprise only border 230 and placessecondary display 220 in the lower left corner. The template arrangesthe video streams such that a first data feed is viewed in a first“window,” a second data feed is viewed in a second “window,” and so on.Either the generic layout or a customized layout defined in the controldata may also include the menu item chosen 240 and marking 250. Anyimages, designs, text, or other custom programming may be present alongwith the four tracks appearing in a secondary display on the display. Inone embodiment, a layout and template includes user functions associatedwith a remote control that appear substantially below each video streamto provide on-screen options for the user.

Using the remote control or mouse, the user may select an additionaltrack or video stream to be switched with the main video appearing onthe display. Referring to FIG. 3 a, a first video 310 appears on display300. Within a secondary display 320 is a second video 330. When the userwatching display 300 sees something of interest in secondary display320, the user presses a button on the remote control or mouse to swapfirst video 310 and second video 330. As a result, referring to FIG. 3b, second video 330 appears full-screen on display 300 and first video310 appears in secondary display 320.

The user may also swap the additional tracks within the secondarydisplay. Referring to FIGS. 3 c and 3 d, a secondary display 320 isshown in a display 300. The user watching display 300 may swap a secondvideo 340 with a third video 350. Similarly, the user may decide to viewa fourth video 360 rather than second video 340. Second video 340 may bedeselected. Third video 350 may replace the location of second video 340in secondary display 320. As a result, the user can customize thesecondary display to show only those desired video streams.

One function is the ability to show and hide any or all of the streamingvideo. Referring to FIG. 4 a, a first video 410 is playing on display400. A user may then decide either to activate Multi-View Mode in orderto show a second video stream. Referring to FIG. 4 b, upon activation ofMulti-View Mode or by commanding to show a second video stream, asecondary display 420 appears containing a second video 430. Secondarydisplay appears on display 400 and over first video 410. A user may thenchoose to display a third video stream. Referring to FIG. 4 c, uponactivation of a third video stream, a third video 440 appears insecondary display 420. The user may decide to show any or all of theavailable video streams.

Alternatively, the user may decide to hide any or all of the streamingvideo. Referring to FIG. 5 a, a first video 510 is playing on a display500. A second video 530 is playing on a secondary display 520. Referringto FIG. 5 b, upon the deselection of Multi-View Mode or by selecting notto view the streaming video of second video 530, the secondary displayand its contents, i.e., second video 530, are no longer displayed ondisplay 500.

The user may guide a cursor around the video screen using a remotecontrol, mouse, pointer, or other device known to one of ordinary skillin the art for directing an object on a screen. The cursor can be usedfor relocating or resizing the secondary display. The cursor may also beutilized for selecting an option or video within the secondary display.The cursor may appear as an arrow or any other shape. In one embodiment,the shape of the cursor relates to the theme of a movie. In analternative embodiment, the cursor may substantially highlight anon-screen button or video.

Unlike conventional picture-in-picture displays, the user can customizethe dimensions of both the primary and secondary displays, rather thanchoosing only a small or large display. By stretching or adjusting thedisplay, the user resizes the video stream displays to any desirablesize.

The user can resize a video in the secondary display through the use ofthe cursor or by other means. Referring to FIG. 6, a secondary display610 is shown with a second video 630 in addition to main video 605 ondisplay 600. A user may click on the second video 630 or a border 620 ofsecondary display 610 in order to resize second video 630. Uponselecting border 620 or second video 630, a visual marking 640 indicatesthat the second video may be resized within display 600. By moving thecursor, remote device, or through use of buttons on the remote device,the user may resize the second video to a desired size. Referring toFIGS. 7 a and 7 b, a secondary display 710 with a second video can beenlarged or made smaller within display 700. As the cursor moves, thewindow resizes smoothly along with the cursor movement. Resizing secondvideo 630 can be done during playback of second video 630 and main video605 without pausing. As a result, a user can experience both streamingvideos to enhance their viewing experience.

In a similar function to resizing the secondary display, a user canreshape the secondary display by changing the aspect ratio. By expandingmore or less in a horizontal or vertical direction, the user canmanipulate the secondary display to better suit the second video in thesecondary display or to block less content in the main video. The aspectratio of the second video changes along with any changes to the aspectratio of the secondary display, even though it may appear to distortcertain images.

The media playback device provides yet another function to allow theuser to customize the view of the secondary display. In one embodiment,changing the aspect ratio does not affect the second video. The onlypart of the second video that would be viewed would be the section stillviewable after resizing the secondary display. The user can crop atleast one side of the secondary display to make a portion of the secondvideo not viewable. The second video continues to play as usual, but thecropped portion is not viewable on the display. The aspect ratio of thesecond video. is not altered.

Upon selecting the secondary display, the user can also choose to movethe secondary display to another location on the screen. Referring toFIG. 8, a secondary display 820 on display 800 has been repositionedfrom the lower left corner to a position that is more centrally located.A user may desire this function to view the contents of a first video810 in the lower left corner. Alternatively, the user may desire toposition the secondary display 820 so that it is easier to view.

Referring to FIGS. 9 a and 9 b, a secondary display 920 is positioned inthe lower left corner of display 900, although secondary display 920 maybe positioned at any location on the screen and moved to any location.Upon deciding to reposition secondary display 920, the user selects thesecondary display 920 and guides it with a cursor to the desiredlocation. Throughout the movement from the first position to the secondposition, the secondary display moves smoothly and the video within thesecondary display continues to play. In order to reposition thesecondary display, the user is not required to pause or stop the mainvideo or those video streams in the secondary display.

The visual properties of the video streams in the secondary display maybe adjusted arbitrarily by the user. Such adjustable visual propertiesinclude, but are note limited to, contrast, tint, or color. A user mayadjust these properties similar to the methods of adjusting theproperties of a television or computer monitor. Controls are availablethrough an on-screen menu and/or use of a remote control with programmedbuttons.

The control program may also define color key or luminance values foreach of the video streams. This give the user the ability to compositevideo streams against each other, allowing for bluescreen-type overlays.The user maximizes the size of the secondary display to completelyoverlay the first video. Referring to FIG. 10, a second video 1020 froma secondary display is maximized over a first video 1010 on display1000. First video 1010 contains a mountain view or background subjectmatter and becomes the background plate. Second video 1020 contains onlya person. By overlaying second video 1020 over first video 1010 andutilizing the bluescreen-type overlay, it appears as though the personof first video 1020 is in the scene of first video 1010. This featuremay be desired, for example, if a user would like to create a moviescene or understand the process for creating such a scene. By swappingone of the videos, the user can see a different subject in the scene orthe subject in a different scene. In an alternative embodiment, furtheraudio and video streams may be used for a multi-layered overlay.

Alpha, or transparency control, over the video streams allows the mediaplayback device to perform dynamic smooth fade transitions and effects.The user may decide to have one alpha transparent video streamoverlaying another video stream. Additionally, this feature allows forone video stream to fade away or into the display.

The media playback device may also be receiving streaming audio tracksin addition to the audio that streams along with the video. The systemallows the user to edit and mix the audio that streams into the videoplayer. At the user's command, the system can place a variety ofgraphic, interactive interfaces on a display. Referring to FIG. 11, asecondary display 1110 is shown on a display 1100. Secondary display1110 has four streaming video feeds 1111, 1112, 1113, 1114 in additionto the main video 1115. Upon selecting to mix the audio on a remotedevice, the user is presented with a series of slider bars 1121, 1122,1123, 1124, 1125 to mix the audio levels of five distinct audio tracks.Slider bars 1121, 1122, 1123, 1124, 1125 correspond to video feeds 1111,1112, 1113, 1114, 1115, respectively. The user can then adjust thevolumes of each audio track for any or all of the video feeds.

While the invention has been described in detail and with reference tospecific embodiments thereof, it will be apparent to those skilled inthe art that various changes and modifications can be made thereinwithout departing from the spirit and scope thereof. Thus, it isintended that the disclosure cover the modifications and variationsprovided they fall within the spirit and the scope as described herein.

1-26. (canceled)
 27. A media playback device for a picture-in-picturepresentation of a first video stream and a second video stream, themedia playback device comprising: at least one media interfaceconfigured to receive the first video stream and the second videostream, wherein the first video stream is associated with first data andthe second video stream is associated with second data; and a processorconfigured to obtain the first data and the second data, the processoris further configured to synchronize the first video stream and thesecond video stream using the first data and the second data indicativeof a relative offset between the first video stream and the second videostream, and the processor is further configured to maintain the relativeoffset between the first video stream and the second video stream forproviding synchronized playbacks of the first video stream and thesecond video stream at the relative offset during the picture-in-picturepresentation.
 28. The media playback device of claim 27, wherein controldata for arranging the picture-in-picture presentation is located withina file in the media playback device.
 29. The media playback device ofclaim 27, wherein control data for arranging the picture-in-picturepresentation is located in a source external to the media playbackdevice.
 30. The media playback device of claim 27, wherein the firstdata and the second data are metadata.
 31. The media playback device ofclaim 27, wherein the processor is further configured to synchronize thefirst video stream and the second video stream by advancing the firstvideo stream and the second video stream at a rate that maintainssynchronization.
 32. The media playback device of claim 27, whereincontrol data for arranging the picture-in-picture presentation islocated in the second video stream.
 33. A method for use by a mediaplayback device for a picture-in-picture presentation of a first videostream and a second video stream, the method comprising: receiving thefirst video stream, wherein the first video stream is associated withfirst data; receiving the second video stream, wherein the second videostream is associated with second data; obtaining the first data and thesecond data; synchronizing the first video stream and the second videostream using the first data and the second data indicative of a relativeoffset between the first video stream and the second video stream; andmaintaining the relative offset between the first video stream and thesecond video stream for providing synchronized playbacks of the firstvideo stream and the second video stream at the relative offset duringthe picture-in-picture presentation.
 34. The method of claim 33, whereincontrol data for arranging the picture-in-picture presentation islocated within a file in the media playback device.
 35. The method ofclaim 33, wherein control data for arranging the picture-in-picturepresentation is located in a source external to the media playbackdevice.
 36. The method of claim 33, wherein the first data and thesecond data are metadata.
 37. The method of claim 33, wherein thesynchronizing the first video stream and the second video streamincludes advancing the first video stream and the second video stream ata rate that maintains synchronization.
 38. The method of claim 33,wherein control data for arranging the picture-in-picture presentationis located in the second video stream.
 39. A picture-in-picturepresentation system comprising: a medium including a first video stream,a second video stream, first data associated with the first video streamand second data associated with the second video stream, wherein thefirst data and the second data determine a relative offset between thefirst video stream and the second video stream; a media playback devicefor a picture-in-picture presentation of the first video stream and thesecond video stream from the medium, the media playback deviceincluding: at least one media interface configured to receive the firstvideo stream and the second video stream; and a processor configured toobtain the first data and the second data, the processor is furtherconfigured to synchronize the first video stream and the second videostream using the first data and the second data indicative of therelative offset between the first video stream and the second videostream, and the processor is further configured to maintain the relativeoffset between the first video stream and the second video stream forproviding synchronized playbacks of the first video stream and thesecond video stream at the relative offset during the picture-in-picturepresentation; a display configured to receive and display thepicture-in-picture presentation of the first video stream and the secondvideo stream.
 40. The picture-in-picture presentation system of claim39, wherein control data for arranging the picture-in-picturepresentation is located within a file in the media playback device. 41.The picture-in-picture presentation system of claim 39, wherein controldata for arranging the picture-in-picture presentation is located in asource external to the media playback device.
 42. The picture-in-picturepresentation system of claim 39, wherein the first data and the seconddata are metadata.
 43. The picture-in-picture presentation system ofclaim 39, wherein the processor is further configured to synchronize thefirst video stream and the second video stream by advancing the firstvideo stream and the second video stream at a rate that maintainssynchronization.
 44. The picture-in-picture presentation system of claim39, wherein control data for arranging the picture-in-picturepresentation is located in the second video stream.